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INTRODUCTION 

In  a  series  of  seminal  papers,  Flandrin  (References  1  and  2)  and  Tewfik  et  al. 
(References  3  through  5)  proved  that  the  Daubechies  wavelets  decorrelate  or  “whiten”  a 
broad  class  of  stochastic  processes  that  have  a  1/f-type  spectra.  Concurrently,  Scribner  et 
al.  (References  6  through  9)  have  asserted  that  a  major  contributor  to  the  fixed  pattern 
nonuniformity  observed  on  infrared  staring  arrays  is  the  1/f-type  spectra  associated  with 
the  sampled  output  of  the  individual  pixels.  Using  measurement  from  an  Amber  128-by- 
128  indium  antimonide  (InSb)  staring  array.  Hewer  and  Kuo  (References  10  and  11) 
combined  these  two  results  to  demonstrate  that  the  Daubechies  wavelets  do  “whiten”  the 
1/f-type  spectra  as  predicted.  Hewer  and  Kuo  also  proposed  fractional  Brownian  motion 
(fBm)  as  a  stochastic  process  that  could  serve  as  a  possible  model  for  the  spectra.  The 
purpose  of  this  note  is  to  demonstrate  that  the  predicted  Daubechies  wavelet  filtering 
properties  that  were  demonstrated  for  InSb  can  be  extended  to  microbolometers. 

In  much  of  the  physics  and  engineering  literature,  1/f  noise  is  characterized  by  a 

spectral  family  F(o  )  «  cr>0  in  a  neighborhood  of  the  origin  with  1  <  a  <  3. 

co 

Flicker  noise  occurs  when  a-l,  and  a  =  2  is  Brownian  noise.  The  study  of  such 
processes  is  somewhat  paradoxical,  because  for  a-l  the  spectrum  is  not  integrable  on 
the  semi-infinite  interval  (0,«»).  This  suggests  that  the  model  implies  infinite  variance  and 
therefore  that  the  spectrum  of  the  process  apparently  cannot  exist  However,  physical 
limitations  of  any  experiment  impose  limits  on  the  frequency  range  that  can  be  measured. 
Moreover,  the  spectrum  will  not  generally  uniquely  characterize  a  stochastic  process.  In 
Hewer  and  Kuo,  fBm  was  proposed  as  a  possible  stochastic  model,  because  it  is 
compatible  with  the  Daubechies  filters  and  has  several  properties  that  match  the  structure 
of  the  measured  pixel  time  series.  In  this  paper  another  stochastic  model  is  proposed  that 
also  has  a  1/f  spectral  family.  This  new  model,  called  power-law  shot  noise,  was  derived 
by  Lowen  and  Teich  (References  12  and  13). 

In  this  note  just  enough  detail  is  included  to  explain  the  terminology  and  relevant 
concepts.  The  interested  reader  can  find  more  details  and  many  references  in  Hewer  and 
Kuo.  The  comprehensive  review  by  Womell  (Reference  14)  of  the  1/f  family  of  fractal 
processes  and  wavelets  is  recommended. 


FRACTIONAL  BROWNIAN  MOTION 


Mandelbrot  and  Van  Ness  (Reference  15)  introduced  the  class  of  stochastic  processes 
called  fractional  Brownian  motion,  which  includes  ordinary  Brownian  motion  as  a  special 
case.  Denoting  the  process  as  BH(  i )  it  is  a  zero-  mean  non  stationary  stochastic  process 
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that  is  indexed  by  a  single  scale  parameter  H.  Here  we  assume  that  BH(  0  )«0  for 
convenience.  The  fBm  covariance  has  the  following  form  for  0  <  H  <  1. 

cov(BH(t,s))«E[BH(t)B„(s)]«  ^-dsf*  +|ifw  -|t-s|2*) 

When  the  index  H  =  1/2  the  fBm  is  ordinary  Brownian  motion. 

Several  algorithms  exist  to  simulate  fBm.  The  Hosking  algorithm  (Reference  16) 

simulates  fBm  with  the  spectral  family  —  *  -  and  fractional  Gaussian  noise  (fGn)  with 

arH*x 

the  spectral  family  — Here  H  denotes  the  Hurst  coefficient  and  H  =  d  +  1/2  with 

|d|£^£.  The  correlation  character  of  fGn  strongly  depends  on  H  and  is  summarized  as  by 
Womell  (Reference  14)  and  Feder  (Reference  17)  as  shown  in  Equation  1. 


d>  0 

persistence 

o 

li 

•o 

no  correlation 

(1) 

d<0 

anti -persistence 

POWER-LAW  SHOT  NOISE 


Power-law  shot  noise,  introduced  by  Lowen  and  Teich,  is  defined  as  follows.  The 
shot  noise  is  expressed  as  an  infinite  sum  of  power-law  impulse  response  functions 

/(0« 

j»— 

where 


0  <A<t<B 
otherwise 


and  the  times  tj  are  random  events  from  a  homogeneous  Poisson  point  process  at  a  rate 
\i .  The  power  spectral  density  S(co)  of  the  process  approaches  the  constant  value  as 
ct)->  0 


S(fi>)-»  UK2 


Ba 


and  as  ft)  — > 


S(o>)  — >  /tK2r2(|  )(fi>r 
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where  r(.,.)  is  the  incomplete  gamma  function  defined  by 
n?>*)s  J7  e~‘tq~xdt . 

The  parameters  A,  B,  K,  a ,p,  and  n(a~  2(l-/J))  are  deterministic  and  fixed. 

When  A  >  Q  and  B  <  °°  the  density  function  for  the  amplitude  will  converge  to  a 
Gaussian  distribution  (I(t) — ^Gaussian)  with  mean  Ci  and  variance  C2,  which  are 
defined  as  follows. 


Ci  =  t*K 


Ci  =  nK 


AP-w 

/3*1; 

ln- 
.  A 

f 

U- 1; 

iA'-W 

-Bi-2y 

A2p-iy 

P  *  0.5; 

tai 

t 

P-0.5; 

DAUBECHIES  WAVELETS 


The  wavelets  <p(t)  introduced  by  Daubechies  (Reference  18)  are  obtained  from  the 
scaling  function  <j>(t),  which  is  the  solution  of  the  two-scale  difference  equation  (a 
dilation  equation) 

m='Lc4Qt-k). 

t 

If  the  coefficient  sequence  {c*}  has  only  a  finite  number  of  nonzero  terms,  the  wavelet 
(pit)  has  compact  support.  The  sequence  {<*}  satisfies  the  following  conditions,  which 
are  respectively  a  normalizing  condition,  an  orthogonality  condition  ( 5**  is  the  discrete 
Dirac  delta  function),  and  a  regularity  or  vanishing  moment  condition. 

Xc»=V2,  ZCkC*-2m  =  2  5om.  £(-l)k  km  Ck  =  0,  m  as  0,l,-",p  - 1  (2) 

The  wavelet  equation  is  constructed  from  the  sequence  {c*}  by  the  quadrature  mirror 
condition 


#D=K-l)*ci-t*<2f-l). 

* 

The  Haar  wavelet  has  compact  support  is  quite  simple  and  is  defined  as  follows. 
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+1  0*t<V2 

fa)—-l  l/2si<l 

0  otherwise 

and  the  scaling  function  is 

f+1  Ostcl 

^ 1  [0  otherwise 

Compactly  supported  Daubechies  wavelets  will  be  denoted  by  DP  with  p  =  1,2,. . . 
with  Di  denoting  the  Haar  wavelet .  The  coefficients  for  the  first  Daubechies  wavelet 
D2  arc 


c-<3+% 

The  compactly  supported  Daubechies  wavelets  form  an  orthonormal  basis  for  L2(R), 
which  means  that  any  function  that  is  a  member  of  L2(R)  can  be  expanded  into  a  wavelet 
series  instead  of  a  Fourier  series.  A  function  that  is  a  member  of  L2(R)  has  “finite  power” 

and  can  be  expanded  into  a  series  using  the  sequence  of  wavelets  j V2^K2'f  -  m)j  as  the 

basis  functions.  Moreover,  for  some  wavelets  all  translates  and  dilates  of  <p(t )  are 
mutually  orthogonal  using  the  inner  product  (*) 

( \l2*qK2kt  -  m))  =  5*  5*. 

The  discrete  wavelet  coefficients  that  represent  the  expansion  in  the  scaling  functions  are 
called  the  approximation  coefficients  aj{n) 

ajtn]  =  (/(0,V 2>*(2'  f  -  n))  =  VF  , 

where  f(t)  is  any  function  in  l2(R).  The  wavelet  expansion  coefficients  are  called  the 
detail  coefficients  dj(n),  because  they  represent  the  difference  between  two  successive 

approximations  and  are  computed  as  follows, 
djln]  =  (/(rX  VPfG'f  -  *))  =  Vi> 

For  any  finite  integer  J,  [‘j2'4(2Jt-m)\jJp<p(2Jt-m)}  is  an  orthonormal  basis  for  l2(R). 

Thus,  any  function  f(t)  in  l2(R)  can  be  written  as  the  nonhomogeneous  wavelet  infmite 
series 
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m  =  JlJ  miaj(m)4(2Jt  -  m)  +  £  "l" JP d j(n)<p(2Jt  -  m ) . 

m=-oo 

This  series  expansion  is  called  a  multiresolution  decomposition  of  f(t).  The 
decomposition  is  multiresolution,  because  the  approximation  coefficients  and  the  detail 
coefficients  are  computed  at  successively  different  scales  indexed  by  j.  Note  the  different 
role  played  by  the  approximation  coefficients  (a  scales)  and  the  detail  coefficients  (d 
scales)  in  the  expansion. 


SMOOTHING  OF  1/f  SIGNALS 


Womell  (Reference  14)  illustrates  extracting  a  1/f  signal  from  a  background  of 
additive  stationary  white  noise.  Donoho  (Reference  19)  has  proposed  wavelet  shrinkage 
as  an  attractive  alternative  for  the  same  purpose.  His  method  shrinks  noisy  wavelet 
coefficients  via  thresholding.  The  method  has  theoretical  properties  that  exceed  anything 
previously  known.  His  method  applies  a  soft-threshold  nonlinearity 
T),(w)  =  J£/i(w)(|w|-0+  with  threshold  t  to  each  empirical  sample  value  w  in  the  wavelet 
transform  d  scales.  After  thresholding  the  wavelet  transform  is  inverted,  yielding  the 
smoothed  data.  Applying  the  soft  threshold  continuously  shrinks  the  empirical 
coefficients  in  the  d  scales  to  zero  and  thus  removes  the  noise. 


SIMULATED  fBm,  1/f  SHOT  NOISE,  AND  CAMERA  TEST  RESULTS 


Figures  1  through  12  use  simulated  fBm  to  illustrate  some  important  stochastic 
estimates  that  will  be  applied  to  the  infrared  camera  data.  A  complete  set  of  references 
and  relevant  concepts  is  contained  in  the  SPIE  paper  or  technical  report  by  Hewer  and 
Kuo  (References  10  and  11).  Although  these  results  and  figures  are  similar  to  those  found 
in  Hewer  and  Kuo,  they  are  included  for  completeness  and  for  a  direct  comparison  with 
the  power-law  shot  noise  simulation  and  the  Honeywell  microbolometer  data. 

Figure  1  is  a  sample  path  containing  3000  points  of  an  anti-persistent  fBm  with  the 

spectral  family  for  H  =0.1.  These  samples  were  generated  using  the  Hosking 

algorithm.  16  Figure  2  shows  the  corresponding  periodograms,  a  log-log  plot  of  the 
periodogram  X(o>)  versus  the  frequency  variable  co.  The  periodogram  X(co)  is  the 
modulus  of  the  Fourier  transform  3(*(n))of  the  discrete  sequence  {xo.-.xam} 

*(<»)  =  (ij3U(n))3(jc(n))*, 
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where  N  is  the  total  number  of  samples  and  ( )*  is  the  complex  conjugate.  The  index  H 
can  be  estimated  from  the  slope  of  the  dotted  line.  It  is  the  least  squares  fit  to  the  lower 
frequencies  on  the  log-log  plot  of  the  periodogram. 

Figure  3  is  the  corresponding  correlation,  which  clearly  exhibits  slow  decay  with 
hyperbolic  shape  and  a  significant  dependence  between  observations  well  separated  in 
time.  The  next  figure  is  a  plot  of  the  correlation  function  for  the  increments.  The 
increments  are  obtained  by  applying  the  differencing  operator  V  to  the  fBm  sequence 
x(n),  which  yields  the  derived  sequence 

Vx(n)  =  x(n)  -  x(n-l). 

Because  the  increments  of  fBm  are  fGn,  the  lagged  correlation  coefficients  will  all  be 
positive  for  persistence  and  negative  for  anti-persistence.  Because  Figure  1  is  a  sample  of 
the  anti-persistent  case,  the  coefficient  is  negative  as  expected. 

Figure  5  shows  quantile-quantile  (Q-Q)  plots  jf  the  increments.  A  Q-Q  plot  can  be 
used  to  compare  the  degree  of  agreement  between  two  empirical  distributions  or  to 
compare  the  empirical  quantiles  with  the  quantiles  from  an  ideal  distribution.  A  Gaussian 
Q-Q  plot  is  a  plot  of  the  ordered  data  yt  from  the  sample  {xo.  -.xat-i}  versus  the  normal 
quantiles  yp  =4>_1(Pj),  where  p,  =  («-]^)/N.  i  =  l,2,—,N,  and  <t>-‘  is  the  inverse  of  the 
standard  normal  distribution  (Reference  20).  If  the  shape  of  the  marginal  distributions  for 
the  increments  is  approximately  normal,  even  in  the  tails,  then  the  empirical  quantile 
sample  values  will  approximate  the  normal  line.  The  approximation  in  Figure  5  is  linear 
even  in  the  tails,  so  die  Gaussian  hypothesis  for  the  marginal  distribution  as  simulated  by 
the  Hosking  fBm  model  is  reasonable. 

Figure  7  is  a  plot  of  the  fourth  scale  detail  coefficients d*{n)  for  the  Daubechies  Dio 
wavelet.  The  next  figure  is  the  corresponding  correlation.  As  expected,  the  Daubechies 
wavelet  decorrelates  or  whitens  the  fBm  process.  The  reason  for  this  fortuitous 
transformation  is  given  by  Flandrin  (Reference  2)  and  Tewfik  and  Kim  (Reference  5)  and 
is  related  to  the  vanishing  moment  properties  defined  in  Equation  2.  The  survey  by 
Womell  should  be  consulted  for  more  discussion  of  the  correlation  structure  of  the 
wavelet  coefficients.  Even  though  the  noise  is  not  Gaussian,  Donoho’s  wavelet  shrinkage 
algorithm  in  S+WAVELETS  was  applied  to  the  fBm  signal  with  satisfactory  results  as 
shown  in  Figure  8. 

Figure  9  is  the  same  fBm  sample  as  in  Figure  1  with  the  addition  of  stationary  white 
noise.  The  additive  noise  has  a  variance  of  3.691,  which  yields  a  signal-to-noise  ratio  of 
zero  decibels.  The  same  processing  sequence  is  reapplied  to  the  signal  in  Figure  9,  and 
the  results  are  shown  in  Figures  10  through  16.  These  examples  show  that  the  processing 
is  “robust”  to  additive  white  noise.  Figure  10  demonstrates  that  the  additive  white  noise 
clearly  does  not  affect  the  low  frequencies  where  the  1/f  noise  dominates  but  does 
contribute  to  the  high  frequencies.  The  one  surprise  is  that  the  wavelet  shrinkage 
produces  a  smoother  curve  in  Figure  16  than  in  Figure  8.  Figures  11  through  15 
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demonstrate  that  the  estimation  techniques  and  Daubechies  filters  are  resistant  to  additive 
white  noise. 

The  1/f  shot  noise  presentation  in  Figures  17  through  24  parallels  the  fBm 
presentation  in  Figures  1  through  8.  The  1/f  shot  noise  is  simulated  with  parameter  values 
p  =  0.4,  K  =  1,  f±=  1,  A  =  0.01,  and  B  =  50.  The  sample  path  in  Figure  17  is  a  vector 
of  length  5000  with  a  sampling  interval  of  0.2.  The  notation  for  fBm  and  the  1/f  shot 
noise  is  consistent  with  the  literature.  The  key  relation  between  the  Hurst  coefficient  H 
for  the  fBm  and  the  parameter  beta  the  power-law  shot  noise  is  H  =  0.5  -  /}.  The  estimate 
for  beta  obtained  in  Figure  18  is  0.390567,  which  is  consistent  with  the  estimates  for 
fBm.  The  remaining  figures  for  this  case  do  not  exhibit  any  unexpected  results. 

Figures  25  through  40  are  an  application  of  the  estimation  techniques  and  the 
Daubechies  filter  applied  to  the  camera  data.  These  results  are  representative  and  not  in 
way  special  or  atypical.  Figure  25  represents  7000  samples  with  a  54  Hertz  sampling  rate 
from  a  single  pixel  measured  by  a  128x128  Amber  AE  4128  InSb  focal  plane  array.  More 
details  on  test  conditions  are  found  in  Hewer  and  KuoJ  *  The  estimate  0.158828  for  H  in 

Figure  26  yields  an  estimate  for  the  spectral  F(co)=  exponent  of  1.317.  Figures  27 

through  32  are  consistent  with  their  simulated  counterparts  and  with  the  hypothesis  that 
the  temporal  pixel  noise  is  a  member  of  the  1/f  spectral  family. 

Figure  33  represents  8046  samples  from  a  single  pixel  measured  by  a  Honeywell 
microbolometer.  A  bolometer  is  an  infrared  detector  that  measures  absorbed,  incident 
infrared  radiation  by  a  voltage  change  in  electrical  resistance  due  to  a  non  equilibrium 
temperature  differential.  The  data  featured  were  provided  by  the  Naval  Research 
Laboratory  in  Washington.,  D.  C.  The  images  are  from  a  Honeywell  uncooled 
microbolometer  336-by-165  IR  sensor  in  the  8-  to  12-micron  spectral  band.  The  data  are 
looking  at  an  extended  blackbody  source  at  25°C  through  an  fl.l  optic  with  80% 
transmission.  The  data  are  digitized  to  256  bit  accuracy  with  a  33-millisecond  frame  time. 
More  information  on  the  Honeywell  microbolometer  can  be  found  in  Gallo  et  al. 
(Reference  21)  and  Wood  (Reference  22).  Again,  the  results  are  consistent  with  their 
parallel  panels  for  the  Amber  camera  and  the  simulated  signals. 


CONCLUSIONS 


In  this  note  the  Daubechies  wavelets  have  again  filtered  and  decorrelated  the  fixed 
pattern  noise  as  predicted  by  the  theory  of  wavelet  transforms,  when  applied  to  random 
signals  with  a  decaying  correlation  structure.  Also  a  simulated  example  demonstrate  that 
power-law  shot  noise  is  consistent  with  the  empirical  data  analysis 
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FIGURE  1.  fflm  With  d  =  0.4  (H  =  0.1). 
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FIGURE  2.  Periodogram  of  Figure  1.  Estimated  H  is 
0.122461. 
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FIGURE  3.  Correlation  Function  of  Figure  1. 
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FIGURE  6.  Daubechies  10  Wavelet  d  Scale  4  of  Figure  1. 
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FIGURE  10.  Periodogram  of  Figure  9.  Estimated  H  is 
0.107295. 


FIGURE  11.  Correlation  Function  of  Figure  9. 


FIGURE  12.  Correlation  Function  of  Inc.ement  of 
Figure  9. 
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FIGURE  13.  Normal  Q-Q  Plot  of  Increment  of  Figure  9. 
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FIGURE  14.  Daubechies  10  Wavelet  d  Scale  4  of  Figure  9. 
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FIGURE  16.  Wavelet  Shrinkage  of  Figure  9. 


FIGURE  17.  1/f  Shot  Noise  With  d  =  0.4  (H  =  0.1). 
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FIGURE  18.  Periodogram  of  Figure  17.  Estimated  H  is 
0.109433. 
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FIGURE  20.  Correlation  Function  of  Increment  of 
Figure  17. 


FIGURE  21.  Normal  Q-Q  Plot  of  Increment  of  Figure  17. 
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FIGURE  22.  Daubechies  10  Wavelet  d  Scale  4  of 
Figure  17. 
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FIGURE  23.  Correlation  Function  of  Figure  22. 


FIGURE  24.  Wavelet  Shrinkage  of  Figure  17. 
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FIGURE  26.  Periodogram  of  Figure  25.  Estimated  H  is 
0.158828. 
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FIGURE  28.  Correlation  Function  of  Increment  of 
Figure  25. 


FIGURE  29.  Normal  Q-Q  Plot  of  Increment  of  Figure  25. 


FIGURE  30.  Daubechies  10  Wavelet  d  Scale  4  of 
Figure  25. 
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FIGURE  31.  Correlation  Function  of  Figure  30. 
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FIGURE  32.  Wavelet  Shrinkage  of  Figure  25. 


FIGURE  33.  Honeywell  Uncooled  Microbolometer  Camera 
Data,  Pixel  (100,1). 
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FIGURE  34.  Periodogram  of  Figure  33.  Estimated  H  is 
0.42459. 
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FIGURE  36.  Correlation  Function  of  Increment  of 
Figure  33. 
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FIGURE  38.  Daubechies  10  Wavelet  d  Scale  4  of 
Figure  33. 
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FIGURE  39.  Correlation  Function  of  Figure  38. 
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FIGURE  40.  Wavelet  Shrinkage  of  Figure  33. 
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